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We study open quantum systems whose evolution is governed by a master equation of 
Kossakowski-Gorini-Sudarshan-Lindblad type and give a characterization of the convex set of steady 
states of such systems based on the generalized Bloch representation. It is shown that an isolated 
steady state of the Bloch equation cannot be a center, i.e., that the existence of a unique steady 
state implies attractivity and global asymptotic stability. Necessary and sufficient conditions for 
the existence of a unique steady state are derived and applied to different physical models including 
two- and four-level atoms, (truncated) harmonic oscillators, and composite and decomposable sys- 
tems. It is shown how these criteria could be exploited in principle for quantum reservoir engineeing 
via coherent control and direct feedback to stabilize the system to a desired steady state. We also 
discuss the question of limit points of the dynamics. Despite the non-existence of isolated centers, 
open quantum systems can have nontrivial invariant sets. These invariant sets are center manifolds 
that arise when the Bloch superoperator has purely imaginary eigenvalues and are closely related 
to decoherence-free subspaces. 
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I. INTRODUCTION 

The dynamics of open quantum systems and especially 
the possibility of controlling it have attracted significant 
interest recently. One of the fundamental tasks of inter- 
est is the stabilization of quantum states in the presence 
of dissipation. In recent years a large number of articles 
have been published on control of closed quantum sys- 
tems or, more precisely, on systems that only interact co- 
herently with a controller, with applications from quan- 
tum chemistry to quantum computing [T|. The essential 
idea in most of these articles is open-loop Hamiltonian 
engineering by applying control theory and optimization 
techniques. Although open-loop control design is a very 
important tool for controlling quantum dynamics, it has 
limitations. For instance, while open-loop Hamiltonian 
engineering can be used to mitigate the effects of deco- 
herence, e.g., using dynamic decoupling schemes or 
to implement quantum operations on logical qubits, pro- 
tected against errors due to environmental interactions 
by a redundant encoding [3], Hamiltonian engineering 
has intrinsic limitations. One task that is difficult to 
achieve using Hamiltonian engineering alone is stabiliza- 
tion of quantum states. 

Alternatively, we can try to engineer open quantum 
dynamics described by a Lindblad master equation [H [5] 
by changing not only the Hamiltonian terms but also the 
dissipative terms. Various ideas along these lines have 
been proposed in several articles [6HTT|. There are two 
major sources of dissipative terms in the Lindblad equa- 
tion: the interaction of the system with its environment. 
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and measurements we choose to perform on the system. 
Accordingly, we can engineer the open dynamics by ei- 
ther modifying the system's reservoir or by applying a 
carefully-designed quantum measurement. In this sense, 
the quantum Zeno effect is a simple model for reservoir 
engineering [12] . In addition, the open dynamics can 
be modified by feeding the measurement outcome (e.g. 
the photocurrent from homodyne detection) back to the 
controller. This idea was first proposed in [TT], where 
a feedback-modified master equation was derived and it 
was shown in [H] that such direct feedback could be used 
to stabilize arbitrary single qubit states with respect to 
a rotating frame. More recently, there have been several 
attempts to extend this work to stabilize maximally en- 
tangled states using direct feedback [BHlP^. The idea of 
reservoir engineering can also be used to stabilize the sys- 
tem in the decoherence-free subspace (DFS) [T3]. In |14j . 
it is illustrated that N atoms in a cavity can be entangled 
and driven into a DFS. In ^15j . several interesting phys- 
ical examples are presented showing how to design the 
open dynamics such that the system can be stabilized in 
the desired dark state. 

Such stabilization problems are a motivation for thor- 
ough investigation of the properties of a Lindblad mas- 
ter equation. Important questions include, for instance, 
which states can be stabilized given a certain general evo- 
lution of the system and certain resources. There are 
a number of classical articles discussing the stationary 
states and their (asymptotic) stability, as well as suffi- 
cient conditions for the existence of a unique stationary 
state [16h-21j. More recently, a detailed analysis of the 
structure of the Hilbert space with respect to the Lind- 
blad dynamics was carried out in |22l I23j , implying that 
all stationary states are contained in a subspace of the 
Hilbert space that is attractive. Necessary and sufficient 
conditions for the attractivity of a subspace or a subsys- 
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tern have been further considered in |24l .'' ]. Nonethe- 
less there are stiU important issues that deserve further 
study. One is the issue of asymptotic stabiUty of station- 
ary states. It is often assumed that uniqueness imphes 
attractivity of a steady state. Although this turns out 
to be true for the Lindblad equation, it does not fol- 
low trivially from the linearity of the master equation, 
and a rigorous derivation of this result is therefore desir- 
able, as is a summary of various sufficient conditions for 
ensuring uniqueness of a stationary state. Similarly, lin- 
ear dynamical systems can have invariant sets or center 
manifolds surrounding the set of steady states. The ex- 
istence of such invariant sets usually precludes converges 
of the system to a steady state, but criteria for the ex- 
istence of non-trivial invariant sets are also of interest 
as they are natural decoherence-free subspaces. Finally, 
many investigations of the steady states have been based 
on considering the dynamics on the Hilbert space of the 
system, e.g., giving criteria for the attractivity of a sub- 
space of the Hilbert space. However, since the steady 
states are points in the convex set of positive operators 
on this Hilbert space, such criteria are not always use- 
ful. For instance, only systems with steady states at the 
boundary of the state space (e.g., pure states) have (non- 
trivial) attractive subspaces of the Hilbert space. While 
these states may be of special interest, since the states 
at the boundary form a set of measure zero, most sys- 
tems will have steady states in the interior. We may not 
be able to engineer a steady state at the boundary, but 
perhaps we could stabilize a state arbitrarily close to it, 
which may be entirely sufficient for practical purposes. 
Thus, complete characterization of the steady states re- 
quires considering the set of positive operators on the 
Hilbert space rather than the Hilbert space itself. 

The purpose of this article is twofold: (i) to further 
investigate the properties of the stationary states of the 
Lindblad dynamics and the invariant set of the dynam- 
ics generated by imaginary eigenvalues, including the re- 
lationship between uniqueness and asymptotic stability 
and (ii) to present several sufhcient conditions for the 
existence of a unique steady state, apply them to differ- 
ent physical models, and show how these criteria could 
in principle be used to stabilize an arbitrary quantum 
state using Hamiltonian and reservoir engineering. In 
Sec. |lT] we introduce the Bloch representation of Lind- 
blad dynamics, which will be used throughout the arti- 
cle. In this representation, the spectrum of the dynamics 
can be easily derived and stability analysis can be con- 
veniently presented. In Sec. |III[ we characterize the set 
of all stationary states as a convex set generated by a 
finite number of extremal points, analyze the properties 
of the extremal points and give several sufhcient con- 
ditions for the uniqueness of the stationary state. We 
also state a theorem that uniqueness implies attractivity. 



which is proved in the appendix. In Sec. IV these condi- 
tions are applied to different systems including two and 
four-level atoms, the quantum harmonic oscillator, and 
composite and decomposable systems, and several useful 



results are derived, including: (i) if the Lindblad terms 
include the annihilation operator, then the system has a 
unique stationary state regardless of the other Lindblad 
terms or the Hamiltonian; (ii) for a composite system, 
if the Lindblad equation contains dissipation terms cor- 
responding to annihilation operators for each subsystem, 
then the stationary state is also unique; (iii) how any pure 
or mixed state can be stabilized in principle via Hamil- 
tonian and reservoir engineering. Finally, in Sec. |Vj we 
discuss the invariant set generated by the eigenstates of 
the dynamics with purely imaginary eigenvalues, and its 
relation to decoherence-free subspaces (DFS), including 
examples how to find or design a DFS. 



II. BLOCH REPRESENTATION OF OPEN 
QUANTUM SYSTEM DYNAMICS 

Under certain conditions the evolution of a quantum 
system interacting with its environment can be described 
by a quantum dynamical semigroup and shown to satisfy 
a Lindblad master equation 



p{t)^~i[H,p{t)]+CDp{t) = Cp{t), 



(1) 



where p{t) is positive unit-trace operator on the system's 
Hilbert space Ti. representing the state of the system, H is 
a Hermitian operator on % representing the Hamiltonian, 
[A, B] = AB — BA is the commutator, and Cupit) — 
J2d'^{^d]p{t), where Vd are operators on H and 

V[VMt) - Vdp{t)VJ - ^(F,VdP(t) + PmJVd). (2) 

In this work we will consider only open quantum systems 
governed by a Lindblad master equation, evolving on a 
finite-dimensional Hilbert space H ~ C^. 

From a mathematical point of view Eq. IS a com- 
plex matrix differential equation (DE) . To use dynamical 
systems tools to study its stationary solutions and the 
stability, it is desirable to find a real representation for 
M by choosing an orthonormal basis cr = {o'k}^=i for 
all Hermitian matrices on 7i. Although any orthonormal 
basis will do, we shall use the generalized Pauli matrices, 
suitably normalized, setting ak = Xrs, k = r + {s — 1)N 
and 1 < r < s < N, where 

Ks = j^,i\r){s\ + \s){r\), (3a) 
X,r^j^{-^\r){s\+^\s){r\), (3b) 
A.. = ^ (ELi - r\r + l){r + 1|) . (3c) 

The state of the system p can then be represented as a 
real vector r = (r^) € of coordinates with respect 
to this basis {cTfc}, 



fc=l 




and the Lindblad dynamics ([T]) rewritten as a real DE: 
r-(L + 5]^D('^))r, (4) 

where L, D'''' are real iV^ x N"^ matrices with entries 
Lmn = Tr(ii7[cr„,a-„]), (5a) 
= Tr(F](7„t/da„) - i Ti[vlVd{<J^,an}). (5b) 

{A, i?} = AB + being the usual anticommutator. As 
(Tn2 — ^7=1, we have tat = 0, and (jlj) can be reduced to 

the dynamics on an {N'^ ~ l)-dimensional subspace, 

s(i) = As(t) +c. (6) 

This is an afBne-linear matrix DE in the state vector 
s = (ri, . . . ,rA,2_i)^. A is an (iV^ - 1) x (A^^ _ 1) real 

matrix with Amn = Lmn + L>mn and c a real col- 
umn vector with Cm = L^n + Sd^miv- Notice that 
this essentially is the A^-dimensional generalization of the 
standard Bloch equation for a two-level system, and we 
will henceforth refer to A as the Bloch operator. The 
advantage of this representation is that all information 
of H and V is contained in A and c and it is easy to 
perform a stability analysis of the Lindblad dynamics in 
matrix- vector form 26J. Defining A = L + D^'*'', we 
have the following relation: 

^=[o^ )■ 

Since Tr(p^) < 1 for any physical state p, the Bloch vec- 
tor s must satisfy ||s|| < (N — 1) /N, i.e. all physical 
states lie in a ball of radius R — ^ {N — l)/N. Note that 
for = 2 the embedding into of the physical states into 
this ball is surjective, i.e., the set of physical states is the 
entire Bloch ball, but this is no longer true for N > 2. 



III. CHARACTERIZATION OF THE 
STATIONARY STATES 

A state p is a steady or stationary state of a dynamical 
system if p = 0. Steady states are interesting both from 
a dynamical systems point of view, as well as for appli- 
cations such as stabilizing the system in a desired state. 
Let <Ess = {p\p = 'C(p) = 0} be the set of steady states for 
the dynamics given by ([!]). As ([T]) is linear in p, €ss inher- 
its the property of convexity from the set of all quantum 
states. (£ss includes special cases such as the so-called 
dark states, which are pure states p = satisfying 
[H,p] — Cd{p) — 0. For some systems it is easy to see 
that there are steady states, and what these are. For a 
Hamiltonian system (£d = 0) it is obvious from Eq. ([T]), 
for instance, that the steady states are those that com- 
mute with the Hamiltonian, i.e., Cgs = {p ■ [H,p\ = 0}. 



FIG. 1: (Color online) (a) Non-convex set as a line segment 
connecting two points in the set is not contained in the set. 
(b) Convex set spanned by five unique extremal points given 
by the vertices of the polygon, (c) Convex set with infinitely 
many extremal points comprising the entire boundary. 

Similarly, for a system with H — subject to measure- 
ment of the Hermitian observable M, the master equa- 
tion ^ can be rewritten as p = ^[M]^ = - i[M, [M,p]], 
and we can show that £ss — {p ■ [M,p] =0}. In gen- 
eral, assuming Sq is the Bloch vector associated with 
a particular steady state, the set of steady states £ss 
for a system governed by a LME ([T]) can be written as 
{sq : A So -I- c = 0} in the Bloch representation. This is 
a convex subset of the afhne hyperplane = {sq -I- v} 
in where v satisfies Av = 0. Moreover, using 

Brouwer's Fixed Point Theorem, we can show that the 
set of steady states <Bss is always non-empty (see Ap- 
pendix |A]) and we have: 

Proposition 1. The Lindblad master equation |Ip al- 
ways has a steady state, i.e., the Bloch equation Asq + 
c = always has a solution and rank(A) = rank(A); 
where A is the matrix A horizontally concatenated by 
the column vector c. 

As any convex set is the convex hull of its extremal 
points, we would like to characterize the extremal points 
of £ss- A point in a convex set is called extremal if it 
cannot be written as a convex combination of any other 
points. See Fig. [T] for illustration of convex sets and ex- 
tremal points. To this end, let supp(/9) be the smallest 
subspace S of H such that n-'-pH-'- = 0, where H is the 
projector onto the subspace S and n-*- is the projector 
onto the orthogonal complement of S in H. 

Proposition 2. The steady state of <Bss is extremal if 
and only if it is the unique steady state in its support. 

Proof. Since any convex set is the convex hull of its ex- 
tremal points, the rank of the extremal point is the small- 
est among its neighboring points, and the rank of bound- 
ary points is smaller than that of points in the interior. 
Suppose that besides the extremal steady state po, there 
is another steady state pi in the subspace supp(po). Then 
any state p2 which is a convex combination of po and pi 
must also be in supp(po)- However, since po is an ex- 
tremal point, the rank of po, which is equal to the di- 
mension of supp(po)i raust be lower than the rank of p2, 
which is impossible. Conversely, let ps be the unique 
steady state in its support. Suppose it is not an ex- 
tremal point, which means that there exist pi and p2 
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with ps = api + (1 — a)p2, a > 0. From Lemma[T]in Ap- 
pendix |Bj pi and p2 also lie in supp(ps), a contradiction 
to uniqueness of steady states in supp(/9s)- □ 

We call a subspace S invariant if any dynamical flow 
with initial state in S remains in 5. It has been shown 
that if pss is a steady state then supp(pss) is invariant |23l ? 
]. Furthermore, Proposition [l] shows that any invariant 
subspace contains at least one steady state. Thus, if pss 
is an extremal point of then supp(pss) is a minimal 
invariant subspace of the Hilbcrt space "H, i.e., there does 
not exist a proper subspace of supp(p]j) that is invariant 
under the dynamics. It can also be shown that supp(pss) 
is attractive as a subspace of H, and supp(pss) has been 
called a minimal collecting subspace in |23j . 

Different extremal steady states generally do not have 
orthogonal supports. For example, for a two level-system 
governed by the trivial Hamiltonian dynamics H — 0, 
€ss is equal to the convex set of all states on H, all pure 
states are extremal points, and it is easy to see that two 
arbitrary pure states generally do not have orthogonal 
supports. Just consider the pure states pi = |0)(0| and 
P2 — ^(|0) + |1))((0| + which are extremal states but 
supp(pi) JL supp(p2)- However, in this case there is an- 
other extremal steady state p^ — with supp(p3) C 
supp(pi) -I- supp(p2) and supp(p3) _L supp(pi). In gen- 
eral, given two extremal steady states pi and p2, we 
have either supp(pi) _L supp(p2), or there exists another 
extremal steady state p^ with supp(/33) C supp(/3i) -I- 
supp(p2) such that supp(pi) _L supp(p3). That is to say, 
given an extremal steady state pi, if there exist other 
steady states, then we can always find another extremal 
steady state p^ whose support is orthogonal to that of 
pi, supp(/9i) _L supp(p3). Finally, let Hss be the union 
of the supports of all steady states pss- It can be shown 
(see, e.g., [23]) that we can choose a finite number of ex- 
tremal steady states pk with orthogonal supports, such 
that Hs = ©fcLiSupp(pk)- This decomposition is gen- 
erally not unique, however. In the above example, any 
two orthonormal vectors of H provide a valid decompo- 
sition of Hss = and no basis is preferable. Therefore, 
such a decomposition of "Hss is not necessarily physically 
meaningful, but it does give the following useful result: 

Proposition 3. // a system governed by a LME ^ has 
two steady states, then there exist two proper orthogonal 
subspaces ofH that are both invariant. 

In addition to the characterization of £ss from the sup- 
ports of its extremal points, it is also useful to character- 
ize the steady states from the structure of the dynamical 
operators H and Vd in the LME ([T]). 

Proposition 4. If p is a steady state at the boundary 
then its support S — supp(/9) is an invariant subspace for 
each of the Lindblad operators Vd ■ 

Proof. A density operator p belongs to the boundary of 
'D{H) if it has zero eigenvalues, i.e., if rank(p) = Ni < N . 



In this case, there exists a unitary operator U such that 



P 



Rll i?i2 
^12 R22 



(7) 



where Rn is an Ni x Ni matrix with full rank, and R12 
and i?22 are N2 x iVi and N2 x N2 matrices with zero 
entries and N2 ^ N — Ni = dimker(p), and 



with H = UHW and Vd = UVdW . Partitioning 



(8) 



H = 



Hii H12 
HI2 H22 



Vd = 



\Ad) .Ad) 

^11 '■^12 

.Ad) ,Ad) 

^21 ^22 



(9) 



accordingly, it can be verified that a necessary and suf- 
ficient condition for p to be a steady state of the system 
is that Rll = R12 ~ R22 = 0, where 



d 

R12 = -\Rii E(^n Vv;^2'^ + ^RllHl2, 

d 

R22^j2^,fRiiiv^t^y. 



(lOa) 

(10b) 
(10c) 



Since Rn is a positive operator with full rank and hence 

strictly positive, the third equation requires V2i^ — 
for all d. The second equation is RnX = for A" = 

-\Y.d^^\\ )'^'^\2 + i^i2, which shows that it will be 
satisfied if and only if the A^i x A^2 matrix X vanishes 
identically, which gives the equivalent conditions 



= -j[i/ii,i?ii]+^2?[y/i^)]i?ii, (lla) 



= v^i' yd. 



(lib) 

(lie) 



The last equation implies that if p is a steady state at the 
boundary then all Vd have a block tridiagonal structure 
and map operators defined on S = supp(p) to operators 
on iS, i.e., S is an invariant subspace for all Vd. □ 

The following theorem (proved in Appendix [C| shows 
furthermore that uniqueness implies asymptotic stability: 

Theorem 1. A steady state of the LME ^ is attractive, 
i.e., all other solutions converge to it, if and only if it is 
unique. 

The fact that only isolated steady states can be attrac- 
tive restricts the systems that admit attractive steady 
states. In particular, if there are two (or more) orthog- 
onal subspaces Hk of the Hilbert space H, which are in- 
variant under the dynamics, i.e., supp£(2'('Hk)) C "Hk 
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for k = 1,2,..., then the dynamics restricted to either 
invariant subspace must have at least one steady state on 
the subspace, and the set of steady states must contain 
the convex hull of the steady states on the Tik subspaces. 
Thus we have: 

Corollary 1. A system governed by LME does not 
have a globally asymptotically stable equilibrium if there 
are two (or more) orthogonal subspaces of the Hilbert 
space that are invariant under the dynamics. 

The previous results give several equivalent useful suf- 
ficient conditions to ensure uniqueness of a steady state. 

Condition 1. Given a system governed by a LME |7p 
with an extremal steady state pss, if there is no subspace 
orthogonal to supp(jOss) that is invariant under all Vd then 
Pss is the unique steady state. 

We compare Condition[l]with Theorem 2 in [15], which 
asserts that if there exists no other subspace that is in- 
variant under all Vd orthogonal to the set of dark states, 
then the only steady states are the dark states. To prove 
that a given dark state is the unique stationay state, The- 
orem 2 in [TS] requires that we show (i) uniqueness of the 
dark state, and (ii) that there exists no other orthogonal 
invariant subspace. Since the dark states defined in |15j 
are extremal steady states. Condition [l] shows that (ii) is 
actually sufficient in that it implies uniqueness and hence 
attractivity of the steady state. 

Condition 2. // there is no proper .subspace of S C. % 
that is invariant under all Lindblad generators Vd then 
the system has a unique steady state in the interior 



IV. APPLICATIONS 



Two and Four-level Atoms 



Equation ( 11 ) also shows that if there are two orthog- 
onal proper subspaces Hi -L H2 of the Hilbert space that 
are invariant under the dynamics, then H = Hi ©7^2 ©^3 
and there exists a basis such that 





'Hii 





^^13 




-y(d) 





y{d)- 
^13 


H = 










, Vd^ 





^22 


y{d) 




Hi 





-^33. 










y{d) 
•^33 . 



for all d, and zi?i3 — \ X]d(^n V^is''' — Oj i-'^-, in partic- 
ular both subspaces are Vd invariant for all Vd- Hence, if 
there are no two orthogonal proper subspaces of % that 
are simultaneously Vd invariant for all V^, then the sys- 
tem does not admit orthogonal proper subspaces that are 
invariant under the dynamics. Thus we have: 

Condition 3. // there do not exist two orthogonal proper 
subspaces of % that are simultaneously Vd invariant for 
all Vd then the system has a unique fixed point, either at 
the boundary or in the interior. 

The following applications show that these conditions 
are very useful to show attractivity of a steady state. 



Let us start with the simplest example, a two-level 
atom governed by the Lindblad master equation 



P - 



-iQ,[iJx, p] + T^['y]p 



with a — |0)(1|. This model describes a two-level atom 
subject to spontaneous emission, or a two-level atom in- 
teracting with a heavily damped cavity field after adia- 
batically eliminating the cavity mode. Noting that the 
Lindblad operator a corresponds to a Jordan matrix 
Jo (2), the previous results guarantee that this system 
has a unique (attractive) steady state. More interest- 
ingly, the previous results still guarantee the existence of 
a unique steady state if the atom is damped by a bath of 
harmonic oscillators 



p=[-iH,p\^^nV[a^p-^{n + l)V[<T]p, 



where n = (e^/^sT _ j^-j-i jg ^j-^g average photon num- 
ber. It suffices that one of the Lindblad term 'D[a]p cor- 
responds to an indecomposable Jordan matrix. In this 
simple case we can also infer the uniqueness of the steady 
state directly from the Bloch representation. We can de- 
compose the Bloch matrix A = A.h + Ad into an anti- 
symmetric matrix A.H corresponding to the Hamiltonian 
part of the evolution and a diagonal and negative- definite 
matrix Ad- Since S"^ As = S"^ Ad s < for any s 7^ 0, 
it follows that Ad is invertible and the Bloch equation 
s = A s + c has a unique attractive stationary state. 

On the other hand, if the atom is subjected to a con- 
tinuous weak measurement such as p = 'D[az]p then we 
can easily verify that the pure states |0) and |1) are 
steady states. Hence, there are infinitely many steady 
states given by the convex hull of these extremal points, 
p,, = a|0)(0| + (1 - a)|l)(l| with < a < 1. Of course, 
this is the well-known case of a depolarizing channel, 
which contracts the entire Bloch ball to the z axis, which 
is the measurement axis. 

In the previous examples uniqueness of the steady state 
followed from similarity of at least one Lindblad operator 
V to an (indecomposable) Jordan matrix. When V is de- 
composable then the last example shows that the system 
can have infinitely many steady states, but similarity of 
a Lindblad operator to an indecomposable Jordan ma- 
trix is only a sufficient condition, i.e., it is not necessary 
for the existence of a unique steady state. If V has two 
or more Jordan blocks, for example, then each Jordan 
block defines an invariant subspace, but provided these 
subspaces are not orthogonal to each other, Condition 3 
still applies, ensuring the uniqueness of the steady state. 

For instance, a system governed by a LME p = 'D\V]p 
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with V = S-^JS, J = Jo (2) ® Ji(2) and 
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has a unique steady state because, although V has two 
eigenvalues and 1 and two proper eigenvectors, the re- 
spective eigenspaces are not orthogonal and there are 
no two orthogonal subspaces that are invariant under V . 
Perhaps more interestingly, for a system with a nontriv- 
ial Hamiltonian, e.g., p = —i[H,p\ +'D\y]p, uniqueness 
of the steady state can often be guaranteed even if V 
has two (or more) orthogonal invariant subspaces, if H 
suitably mixes the invariant subspaces. 

Consider a four-level system with energy levels as illus- 
trated in Fig. [2] and spontaneous emission rates 734, 723 
and 7i2 satisfying 734,712 > 723- This is a simple model 
for a laser. To derive stimulated emission we require pop- 
ulation inversion, a cavity and a gain medium composed 
of many atoms. For simplicity, we only consider one atom 
and try to describe the dynamics in the time scale such 
that the spontaneous decay 3 — > 2 can be neglected. On 
this scale the Hamiltonian optical-pumping term H and 
the spontaneous decay term are: 

i? = a(|l)(4| + |4)(l|), 

= 734|3)(4|, 
1^2 =7i2|l)(2|. 

There are two invariant subspaces under Vi and V2'. 
Hi = span{|l), |2)} and H2 — span{|3), |4)}. Hence, 
when a = 0, we have two metastable states |2) and |3) 
in addition to the ground state |1), which is a steady 
state. However, for a ^ the pumping Hamiltonian 
H mixes up those two invariant subspaces, and through 
calculation we can easily find the unique steady state: 
Pss — |3)(3|. Thus, on the time scales considered, popu- 
lation inversion between states |3) and |2) can be realized, 
but eventually spontaneous emission from |3) to |2) will 
kick in, resulting in the stimulated emission characteris- 
tic of a laser. (Of course, this is only the first stage of 
the whole process and it is far from the threshold of the 
laser.) 

This is just one example of optical pumping, a tech- 
nique widely used for state preparation in quantum op- 
tics. Although the principle of optical pumping is easy to 
understand intuitively for simple systems in that popu- 
lation cannot accumulate in energy levels being pumped, 
forcing the population to accummulate in states state not 
being pumped and not decaying to other states, it can 
be difficult to intuitively understand the dynamics in less 
straightforward cases. For example, what would happen 
if we applied an additional laser field coupling |3) and |4). 
Would the system still have a unique steady state? If so, 
what is the steady state? These questions are not easy 
to answer based on intuition, but we can very easily an- 
swer them using the mathematical formalism developed. 




FIG. 2: Schematic plot of the four energy levels of one atom 
in a prototype system for a laser. The atom is pumped by an 
external field. The spontaneous decay rates satisfy 734,712 > 
723. On the time scale when decay from level 3 to 2 can be 
ignored pss = |3)(3| is the unique steady state of the system, 
realizing the population inversion. 



especially the Bloch equation. In fact, we easily verify 
that the system 

m = -t[H,p] + 734l?[|3)(4|]p + 7i2l?[|l)(2|]p 

withiJ = a(|l)(4|-|-|4)(l|)-|-/3(|3)(4| + |4)(3|) hasaunique 
steady state 

/?2 -a/3 0- 

-a/3 a2 




independent of 712 and 734, provided 712,734 7^ 0. For 
/3 = this state becomes |3)(3|, as intuition suggests. 



B. Quantum Harmonic Oscillator 

The harmonic oscillator plays an important role as a 
model for a wide range of physical systems from pho- 
ton fields in cavities, to nano-mechanical oscillators, to 
bosons in the Bose-Hubbard model for cold atoms in op- 
tical lattices. Although strictly speaking the harmonic 
oscillator is defined on an infinite-dimensional Hilbert 
space, the dynamics can often be restricted to a finite- 
dimensional subspace. For many interesting quantum 
processes the average energy of the system is finite and 
we can truncate the number of Fock states /Vmax from 00 
to a large but finite number. In many quantum optics 
experiments, for example, the intracavity field contains 
only a few photons, or has a number of photons in some 
finite range if it is driven by a field with limited intensity. 
In such cases the truncated harmonic oscillator is a good 
model for the underlying physical system provided A^max 
is large enough, and we can apply the previous results 
about stationary solutions and asymptotic stability. 

Consider a harmonic oscillator with Hq = hujc^c where 
c is the annihilation operator of the system, which on the 
truncated Hilbert space with A^max = A^, takes the form 



N-l 

c oc Vn + l\n){n + 1|. 

n=0 



(12) 
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If there is a Lindblad term of the form X'[c]p then we can 
infer from the previous analysis that the system has a 
unique and hence asymptotically stable steady state, re- 
gardless of whatever Hamiltonian control or interaction 
terms or other Lindblad terms are present. To see this 
note that the matrix representation of c is mathemati- 
cally similar to the Jordan matrix 

Jo(7V)= 5] |n>(n + l|. (13) 

It is easy to verify that J has a sole proper eigenvector 
whose generalized eigenspace is all of H and thus does not 
admit two orthogonal proper invariant subspaces. Hence 
we can conclude from Condition 3 that for any dynamics 
governed by a LME ([I]) with a dissipation term I?[c]p, 
there is always a unique stationary solution to which any 
initial state will converge. In general, if ([T]) contains a 
Lindblad term 'D[V]p with V similar to a Jordan matrix 
Ja{N) ^ aiN + Jo{N), then ([T]) always has a unique 
stationary state, no matter what the other terms are. 
For example, the Lindblad equation for a damped cavity 
driven by a classical coherent field a is 

p ~ --[a*c — ac\p] + 'D[c]p = 2?[aljv + c\p, 

showing that the system has a unique steady state. For 
= 4 the steady state is 

(1 + a'^A -aA a^B -a^X 
-aA a^A -a^B 
a^B -a^B a'^B -a^ 

with a real, A = a^B + 1, B ^ + 1 and G = 4a^ -I- 
Sa*^ -I- 2a^ H- 1. When a = 0, i.e. there is no driving field, 
we get pss is the ground (vacuum) state, as one would 
expect for a damped cavity, while for a nonzero driving 
field we stabilize a mixed state in the interior. 



C. Composite Systems 

Many physical systems are composed of subsystems, 
each interacting with its environment, inducing dissi- 
pation. For example, consider N two-level atoms in a 
damped cavity driven by a coherent external field. As- 
suming the atom-atom and atom-cavity interactions are 
not too strong, and the main sources of dissipation are 
independent decay of atoms and the cavity mode, respec- 
tively, we obtain the Lindblad terms I'[it„] , n = 1, . . . , iV, 
and 2?[c] in the LME ([!]), where tT„ is the decay operator 
a = |0)(1| for the nth atom and c is the annihilation op- 
erator of the cavity. Simulations suggest systems of this 
type always have a unique steady state, and this can be 
rigorously shown using the sufficient conditions derived. 

A composite quantum system whose evolution is gov- 
erned by a LME containing terms involving annihilation 



operators for each subsystem has a unique steady state, 
regardless of the Hamiltonian and any other Lindblad 
terms that may be present. This property can be inferred 
from Condition 3. Assume the full system is composed of 
K subsystems with Lindblad terms I?[crfe]p, fc = 1, . . . , if 
and let "H/ be an invariant subspace for all cr^. Then T-Li 
must contain the ground state |0) = jO)**^ of the com- 
posite system as crfc|0) = for all k. Hence, any simulta- 
neously CTfc-invariant subspace must contain the state |0) 
and there cannot exist two orthogonal proper subspaces 
of % that are invariant under all cTfc. By Condition 3, the 
system has a unique steady state. 

Thus, a system of N atoms in a damped cavity subject 
to a Lindblad master equation 

N 

p{t) = p{t)] + -lV[c]p + lnV[(Jr,]p 

has a unique steady state, regardless of the Hamiltonian 
H. The steady state need not be |0) , however. In general, 
this will only be the case if |0) is an eigenstate of H . 
Similarly, the presence of the two dissipation terms I?[crfc] 
in the LME for the two-atom model in 

p{t) = -i[J + j\p{t)]+-lV[J]p+ J2 lkV[ak]p 

k = l,2 

with J = <Ti + (72 ensures that there is a unique steady 
state provided > 0. This is no longer the case for 
7fc = 0. In particular, in the regime where 71,72 ^ 7 
and the last two terms can be neglected as in [7], the 
reduced dynamics no longer has a unique steady state. 

D. Decomposable Systems 

A system is decomposable if there exists a decompo- 
sition of the Hilbert space H — ®m=i^m such that 
p = for any p(0) = ©^^iP^^^O) where 

p^™'(0) is an (unnormalized) density operator on Hm- 
Decomposable systems cannot have asymptotically sta- 
ble (attractive) steady states by Corollary [ij 

One class of systems that are always decomposable and 
hence never admit attractive steady states, are systems 
governed by a LME p]) with a single Lindblad operator V 
that is normal, i.e., [F, y^^] — 0, and commutes with the 
Hamiltonian. This is easy to see. Normal operators are 
diagonalizable, i.e., there exists a unitary operator U such 
that UVW = D with D diagonal, and since [H, V] = 0, 
we can choose U such that it also diagonalizes H. Thus 
the system is fully decomposable, and it is easy to see 
in this case that every joint eigenstate of H and V is 
a steady state, and therefore there exists a steady-state 
manifold spanned by the convex hull of the projectors 
onto the joint eigenstates of H and V. In the absence of 
degenerate eigenvalues this manifold is exactly the N — 
1 dimensional subspace of consisting of operators 

diagonal in the joint eigenbasis of H and V. 
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Modulator ^ 



Laser 



FIG. 3: Schematic diagram of an atomic system under direct 
quantum feedback control. A laser beam is split to gener- 
ate the local oscillator c for homodyne detection as well as 
the driving field ao which is then modulated by the feedback 
photocurrent I{t) to derive the final field a + sl{t). 



A more interesting example of a physical system that 
is decomposable, and thus does not admit an attractive 
steady state, is a system of n indistinguishable two-level 
atoms in a cavity subject to collective decay, and possibly 
collective control of the atoms as well as collective ho- 
modyne detection of photons emitted from the cavity, as 
illustrated in Fig.jsj Let a — |0)(1| be the single-qubit an- 
nihilation operator and define the single-qubit Pauli op- 
erators CTj; = (J + (t\ <Ty — i{a — a^) and — ~2[(Tx, (Jy]. 
Choosing the collective measurement operator 



M 



a^^^ being the n-fold tensor product whose £th factor is 
cr, all others being the identity I2, and the collective local 
control and feedback Hamiltonians 



UxJx + Uyjy + U^J^, F ^ XHc, 



where Ja = Yll.=i'^'a^ ^ ^ {XtUtZ}, the evolution of 
the system is governed by the feedback-modified Lind- 
blad master equation 



P{t) 



i[Ho +Hc + APF + FAF p] + V[M - iF]p, 



assuming local decay of the atoms is negligible. It is easy 
to see from the master equation above that the system 
decomposes into eigenspaces of the (angular momentum) 
operator 

J = Jj, + Jj, + , 

i.e., both the measurement operator M and the con- 
trol and feedback Hamiltonians He and F (and hence 
AI^ F + FM) can be written in block-diagonal form with 
blocks determined by the eigenspaces of J. Therefore, 



the system is decomposable and we cannot stabilize any 
state, no matter how we choose u = (ux,Uy,Uz,X). For 
n — 2 this system was studied in [37] in the context of 
maximizing entanglement of a steady state on the J = 1 
subspace using feedback, although the question of stabil- 
ity of the steady states was not considered. Although the 
system does not admit an attractive steady state in the 
whole space, we can verify that €ss contains a line seg- 
ment of steady states that intersects both the J = and 
J — \ subspaces in a unique state. Thus J = 1 subspace 
has a unique steady state determined by u, to which all 
solutions with initial states in this subspace converge. 



E. Feedback Stabilization 

An interesting possible application of the criteria for 
the existence of unique, attractive steady states is the 
possibility of engineering the dynamics such that the sys- 
tem has a desired attractive steady state by means of co- 
herent control, measurements and feedback. An special 
case of interest here is direct feedback. Systems sub- 
ject to direct feedback as in the previous example, can 
be described by a simple feedback-modified master equa- 
tion dl]: 



p{t) = -t[H,pit)]+V[M ~tF]pit), 



(14) 



where H ^ Hq + He + \{M^ F + FM) is composed of 
a fixed internal Hamiltonian Hq, a control Hamiltonian 
He and a feedback correction term ^{M^ F -\-FM). This 
master equation is of Lindblad form, and hence all of the 
previous results are directly applicable. Setting 

V ~iF, (15a) 

M = V + V\ (15b) 

F = i{V-V^), (15c) 

He = H - Ha - \ {M^F + FM) (15d) 

we see immediately that if the control and feedback 
Hamiltonian, He and F, and the measurement operator 
M are allowed to be arbitrary Hermitian operators, then 
we can generate any Lindblad dynamics. This is also true 
for a non-Hermitian measurement operator M as arises, 
e.g., for homodyne detection, since the anti-Hermitian 
part of M can always be canceled by the effect of the 
feedback Hamiltonian F in — iF]. Given this level 
of control, it is not difficult to show that we can in prin- 
ciple render any given target state pss, pure or mixed, 
globally asymptotically stable by choosing appropriate 
H and V or, equivalently, by choosing appropriate He, 
F and M. 

To see how to do accomplish this in principle, let us 
first consider the generic case of a target state Pss is in the 
interior of the convex set of the states with rank(/9ss) = 
N. A necessary and sufficient condition for pss to be an 
attractive steady state is 

(i) -i[H,pss]+V[V]pss^O and 
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(ii) no (proper) subspace of H is invariant under ([!]) . Proposition [4] shows that we must have 



The first condition ensures that pss is a steady state, and 
the latter ensures that it is the only steady state in the 
interior by Corollary [2j It is easy to see that choosing V 
and H such that 



-1/2 







(16) 



where U is unitary, ensures that (i) is satisfied as 

^UU^ -\{p-,\ p..} = 1-1 = 0. 

To satisfy (ii) we must choose U such that V has no 
orthogonal invariant subspaces, or equivalently H mixes 
up any two orthogonal invariant subspaces V may have. 
If Pss = ^fcllfe, where 11^, is the projector onto the kth 
eigenspace then the invariance condition implies that U 
must not commute with any of the projection operators 
life, or any partial sum of life such as Hi +112. To see 
this, suppose U commutes with n„ = \n){n\, a projector 
onto an eigenspace of pss- Then \n) is a simultaneous 
eigenstate of U and pss with U\n) = e'^'^\n) and p\n) = 
a|n) , where a must be real and positive as p^s is a positive 
operator, and we have |n)(n|] = 0, {pg^-'^, |n) = 
2a~^\n){n\, \n) is an eigenstate of V 



V\n) = Up-^''^\n) = Ua-^/^\n) = 



and thus V\n){n\V^ = a~'^\n){n\ and V[V]\n){n\ = 0, 
i.e., is a steady state of the system at the bound- 

ary. Hence, the steady state is not unique, and p^s cannot 
be attractive. In practice almost any randomly chosen 
unitary matrix U such asU = exp(z(X + where X 

is a random matrix, will satisfy the above condition, and 
given a candidate U it is easy to check if it is suitable by 
calculating the eigenvalues of the superoperator A in (|6]) . 
Of course, choosing H and V of the form ( 16 ) is just one 
of many possible choices for condition (i) to hold. It is 
possible to find other suitable sets of operators {H, V) in 
terms of {Hc,F,M) when the class of practically realiz- 
able control and feedback operators or measurements is 
restricted. For example, we can easily verify that pss is 
the unique attractive steady state of a two-level system 
governed by the LME ([T]) with 



H = 



1 

1 



,v = 



1 {V3-l)i 
(3 - V3)i 1 



,Pss = 



! 



even though H and V do not satisfy ( 16 1. Thus, there are 



generally many possible choices for the control, measure- 
ment, and feedback operators that render a particular 
state in the interior asymptotically stable. 

If the target state Pss is in the boundary of the convex 
set of the states, i.e., rank(pss) < N, then the proof of 



0= -i[Hu,Rii]+T^[Vii]Rii, 
= -^V^,V,2 + ^H,2, 

= V21. 



(17a) 
(17b) 
(17c) 



with Vki and i/fe^ defined as in Eq. to ensure that p 
is a steady state. To ensure uniqueness we must further 
ensure that there are no other steady states. This means, 
by Corollary [s] that (a) we must choose Hn and Vn 
such that is the unique solution of (17i), and thus 
no subspace of 5 = supp(pss) is invariant, and (b) we 
must choose the remaining operators H12 and V12 and 
V22 such that (17d) is satisfied and no subspace of S-^ is 



invariant, because if such a subspace 52 exists, then Si 
and 52 will be two proper orthogonal invariant subspaces 
and Pss will not be attractive. 

One way to construct such a solution is by choos- 
ing Hii such that [Hii,Rii] = and setting Vu = 

— 1/2 

UiiRii , where Un is a suitable unitary operator de- 
fined on S as discussed in the previous section. Then 
we choose V22 such that no proper subspace of 5^ is in- 
variant. Finally, we must choose V12 and -ffi2 such that 
( 17 3) is satisfied and 5^ is itself not invariant. Although 



these constraints appear quite strict, in practice there are 
usually many solutions. 

For example, suppose we want to stabilize the rank- 
3 mixed state Pss = | diag(l, 3, 4, 0) at the boundary. 
Then we partition p, V and H as above, setting Vn = 
URii with Rii = I diag(l, 3, 4) and U a suitable unitary 
matrix such as 



U = 



1 

1 

1 



Then we choose Hn such that [Hn^Rn] = 0, e.g., we 
could set Hii = ViiVii, a choice, which ensures that pss is 
the unique steady state on the subspace S = supp(pss). 
Next we choose V12 such that iS"*" is not an invariant 
subspace. Any choice other than V12 = (0, 0, 0) will do in 
this case, e.g., set V12 = (1,0,0). Finally, we set H12 = 
~^V^iVi2, V21 = (0,0,0)^ and V22 ^ to ensure that 
Pss is the unique globally asymptotically stable state. 

Note that the Hamiltonian, which was not crucial for 
stabilizing a state in the interior and could have been set 
to H = 0, does affect our ability to stabilize states in the 
boundary. We can stabilize a mixed state in the bound- 
ary only if H12 0. If H12 = then Eq. (17d) implies 
V11V12 = 0, and there are two possbilities. If V12 7^ 
but Vii has a zero eigenvalue, then the system restricted 
to the subspace S has a pure state at the boundary and 
thus Rii cannot be the unique attractive steady state 
on S. Alternatively, if V12 = then V is decomposable 
with two orthogonal invariant subspaces S and S'^, and 
Pss cannot be attractive either, consistent with what was 
observed in 1551. 
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Target states at the boundary include pure states. S 
in this case is a one-dimensional subspace of 'H, and 



Eq. ( 17i) is trivially satisfied as Hn and Vn have rank 1, 
and the crucial task is to find a solution to Eq. ^17\)) such 
that no subspace of 5^ is invariant. If H12 — then this 
is possible only if Vii =0 and thus if V has a zero eigen- 
value, as was observed in [28 , but again, if 7J 7^ then 
there are many choices for H and ^12, V22 that stabilize a 
desired pure state. For example, we can easily check that 
the pure state pss = |1)(1| is a steady state of the sys- 
tem p = —i[H,p] +'D[V]p if V is the irreducible Jordan 
matrix Ja{N) with eigenvalue a and H12 = — |a*|l)(2|. 



V. INVARIANT SET OF DYNAMICS, 
DECOHERENCE-FREE SUBSPACES 

Having characterized the set of steady states, the ques- 
tion is whether the system always converges to one of 
these equilibria. The previous sections show that this 
is the case if the system has a unique steady state, as 
uniqueness implies asymptotic stability. In general, how- 
ever, this is clearly not the case for a linear dynamical sys- 
tem. Rather, all solutions converge to a center manifold 
^inv, which is an invariant set of the dynamics, consist- 
ing of both steady states and limit cycles [29] . Although 
we have seen that the Lindblad master equation ([T]) does 
not admit isolated centers, limit cycles often do exist for 
systems governed by a LME. This is easily seen when we 
consider the special case of Hamiltonian systems. In this 
case any eigenstate of the Hamiltonian is a steady state 
but no other dynamical flows converge to these steady 
states. For the Bloch equation ^ (Sinv can be char- 
acterized explicitly. Consider the Jordan decomposition 
of the Bloch superoperator, A — S3S~^, where J is the 
canonical Jordan form. Let 7^ — ai + i/3i be the eigenval- 
ues of A and H^ be the projector onto the (generalized) 
eigenspace of the eigenvalue 7, and let I be the set of 
indices of the eigenvalues of A with ai = 0. 

Definition 1. Let be the affine subspace ofM.^ 
consisting of vectors of the form {sq + w}, where Sq is 
a solution 0/ Asq + c = 0, and w G €cc; where £cc = 
^£g2;H^^(IR^ direct sum of the eigenspaces of 

A corresponding to eigenvalues with zero real part. Then 
the invariant set (Sjnv = 2;jnv ^ '^s.i'H). 



It is important to distinguish the invariant set £inv, 
which is a set of Bloch vectors (or density operators), 
from the notion of an invariant subspace of the Hilbert 
space H. In particular, as €inv contains the set of steady 
states £ss, it is always nonempty. Although supp(2;inv), 
i.e., the union of the supports of all states in £invj 
is clearly an invariant subspace of "H, in most cases 
supp(£inv) will be the entire Hilbert space. In partic- 
ular, this is the case if £inv contains a single state in the 
interior, and supp(£inv) will be a proper subspace of the 
Hilbert space only if all steady states are contained in 



a face at the boundary. This shows that proper invari- 
ant subspaces of the Hilbert space exist only for systems 
that have steady states at the boundary, and the maxi- 
mal invariant subspace of the Hilbert space can only be 
less than the entire Hilbert space if there are no steady 
states in the interior. 

Theorem 2. Every trajectory s{t) of a system governed 
by a Lindblad equation asymptotically converges to Sinv- 

Proof. Let Sq be a solution of the affine-linear equa- 
tion Asq + c = 0, which exists by Prop. [T] A(t) = 
s(t)— Sq satisfies the homogeneous linear equation A(t) — 
AA{t) = SJS"^A(i), where J = diag(j£) is the Jor- 
dan normal form of A consisting of irreducible Jordan 
blocks Ji of dimension kg with eigenvalue 71 . Setting 
x(t) = S-iA(i) gives x{t) = Jx(i) and x(i) = e*^x{0), 
where e*"' is block-diagonal with blocks 



Eiit) 



Re tRf 
Re 




\t^Re 
tRi 
Re 



^t^Re 
tRf 



(18) 



where R( = 1 ii (3( = 0, otherwise 



Rf — 



cos{tf3e) 
sm{t(3i) 



- sm{t/3i) 
cositPe) 



(19) 



Since the dynamical evolution is restricted to a bounded 
set, the matrix A cannot have eigenvalues with positive 
real parts, i.e., ae < 0, and taking the limit for t ^ 00 
shows that the Jordan blocks with ae < are annihilated, 
and thus A(i) — > Sxqo = w e (£cc and s{t) — Sq + 
Sx(t)^So+w. □ 

The dimension of the invariant set, or more precisely, 
the affine hyperplane of M.^ ~^ it belongs to, is equal to 
the sum of the geometric multiplicities of the eigenvalues 
7^ with zero real part, while the dimension of the set of 
steady states is equal to the number of zero eigenvalues of 
A- Thus, in general, the invariant set is much larger than 
the set of steady states of the system. Convergence to a 
steady state is guaranteed only if A has no purely imag- 
inary eigenvalues. In particular, if all eigenvalues of A 
have negative real parts, i.e., 1 = 0, then all trajectories 
s{t) converge to the unique steady state Sgs = — A~^c. 
If A has purely imaginary eigenvalues, then the steady 
states are centers and the invariant set contains center 
manifolds, which exponentially attract the dynamics |29) . 
In cither case the trajectories of the system are 



s(i) =so + Se*-'S-i(s(0) - So), 



(20) 



and the distance of s(t) from the invariant subspace 

d(s(i),(£i„v) = ||Sx^(<)||, (21) 



where x-'-(i) = J2e<^i -^ii^)^'yei^i'^))- Equation. (18) also 
shows that any eigenvalue with zero real part cannot 
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have a nontrivial Jordan block as the dynamics would 
become unbounded otherwise. Thus the geometric and 
algebraic multiplicities of eigenvalues with zero real part 
must agree. Moreover, the eigenvalues of the (real) ma- 
trix A occur in complex conjugate pairs j — a ± ij3. 
Thus, if A has a pair of eigenvalues ±ia with multiplic- 
ity fc, then the center manifold (as a subset of is 
at least 2k dimensional. Finally, as a unique steady state 
cannot be a center, it follows that if A has purely imagi- 
nary eigenvalues, then it must also have at least one zero 
eigenvalue, and there will be a manifold of steady states, 
all of which are centers. The properties of the invariant 
set are nicely illustrated by the following example. 

Consider a four-level system with p[t) — —i[H,p\ + 
'D[V]p, where 



H 



V5 
15 



6 2 1-2- 
2-621 
12 2 6 

-2 1 6-2 



V 



1 -2 -1 r 
1-1-10 

0- 101 

1- 1-10 



V is indecomposable and has two proper and two gen- 
eralized eigenvectors with eigenvalue 0. Let Hq be the 
subspace of H spanned by the proper eigenvectors. H 
is blockdiagonal with respect to a suitable orthonormal 
basis of Ho © Hq, and there is a ID manifold of steady 
states 



Pc(a) 



1 

10 



■3-20a -5a + l 2-15a -Sa + f 

-5a+l lOa + 2 -15a-l lOa + 2 

2-15a -15a-l 3 -15a-l 

-5a+l lOa + 2 -15a-l lOa + 2 



where a S ^[—1, 1]. We can verify that the Bloch ma- 
trix A has a pair of purely imaginary eigenvalues ±2i in 
addition to a eigenvalue and that the invariant set £inv 
consists of all density matrices with support on the sub- 
space Ho spanned by the proper eigenvectors of V defined 
above. In terms of the corresponding Bloch vectors the 
invariant set corresponds to the intersection of a three- 
dimensional invariant subspace of with Dm{H). This 
subspace is what we refer to as the "face" at the bound- 
ary, although note that this face is in fact homeomorphic 
to the 3D Bloch ball in this case. Fig. |4]ja) shows that 
all trajectories converge to €inv, but (b) shows that the 
trajectories do not converge to steady states (except for 
a set of measure zero). Rather, states starting outside 
the invariant set converge to paths in Cinv, which in this 
example are circular closed loops. It is also important to 
note that most initial states, even initially pure states, 
converge to mixed states (with lower purity) with sup- 
port on the invariant set [see Fig. |4][c)]. 

Although this example may seem rather artificial the 
properties of the invariant set and the convergence be- 
havior illustrated here are relevant for real physical sys- 
tems. One important class of physical systems with 
nontrivial invariant sets are those that possess (non- 
trivial) decoherence-free subspaces (DFS). By nontrivial 
we mean here that <Binv or the DFS consists of more than 
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time (arb. units) 



FIG. 4: (Color online) Semilogarithmic plots of (a) the dis- 
tance of s(f) from the invariant set ffinv, (b) the distance from 
the set of steady states, and (c) the purity ||s(t)|| as a func- 
tion of time for 50 trajectories starting with 50 random initial 
states So. (a) All of the trajectories converge to the invariant 
set at a constant rate, indicating exponential decay to the 
invariant set, but the distances of the trajectories from the 
smaller set of steady states (Esa C £inv in (b) do not decrease 
to zero; rather they converge to different limiting values, con- 
sistent with convergence of each trajectory to a different limit 
cycle inside the invariant set. As expected considering that 
the set of steady states <S.ss is a measure-zero subset of Cinv, 
the Hmiting values of the distances are strictly positive, i.e., 
none of the 50 trajectories converges to a steady state, (c) 
The trajectories converge to various mixed states. All limit- 
ing values are far below |V3, the limiting value for a pure 
state, i.e., none of the 50 trajectories converges to a pure 
state, again as expected, as the set of pure states in £inv is a 
measure zero subset. 
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one point. A DFS T-Lbfs is generally defined to be a sub- 
space of the Hilbert space H that is invariant under the 
dynamics and on which we have unitary evolution. In 
general this means that Cd{p) = if supp(p) C "Hdfs- 
Thus there should exist a Hamiltonian H and Lindblad 
operators Vk such that e "Hdfs for any e "Hdfs 

and X]fc^[^fc]P = for any p with supp(p) C 'Hdfs- We 
must be careful, however, because the decomposition of 
Cd is not unique and the Lindblad terms can contribute 
to the Hamiltonian as we have already seen above, so the 
effective Hamiltonian on the subspace may not be the 
same as the system Hamiltonian without the bath. 

Proposition 5. If a system governed by a LME has 
a DFS then "Hdfs C supp(2;inv) Bind any state p with 
supp(p) C "Hdfs belongs to i£inv- 

Proof. If Hdfs is a proper subspace of V. then the states 
with support on it correspond to a face F at the boundary 
of the state space of Bloch vectors or positive unit-trace 
operators p. As Hbfs is an invariant subspace of "H, 
the face F must be invariant under the dynamics, i.e., 
A s -I- c e F for any s G F, and thus the face F must 
contain a steady state Sgs with A Sgs + c = 0. Moreover, 
there exists a subspace S of such that for any s e 

F we have s = Sgg-l-v with v G S. Let Ah and Ad be the 
Bloch operators associated with the Hamiltonian H and 
dissipative dynamics. We can take Ah and Ad to be the 
anti-symmetric and symmetric parts of A, respectively. 
If p is a state with support on "Hdfs then its Bloch vector 
s must satisfy 

As + c = ASss + Av + c = Av 
= {Ah + Ad)v = Ah v 

for all V G S*. Due to the invariance property we have 
Ah V G and as Ah is a real antisymmetric matrix, 
it has purely imaginary eigenvalues. This shows that v 
must be a linear combination of eigenvectors of A with 
purely imaginary eigenvalues, i.e., v g €cc and s e Sinv 

□ 

There are many examples of systems that have 
decoherence-free subspaces. For instance, in the exam- 
ple above we can verify that Ho is a DFS as Hq is in- 
variant under the Hamiltonian dynamics and for any p 
with support on "Hp we have trivially 'D[V]p = as Hq 
is the subspace of H spanned by the two (nonorthogo- 
nal) eigenvectors of V with eigenvalue 0. Hence, p = 
J2k=i,2^k\'>Pk){'^k\ and V\ipk) = for fc = 1,2 implies 

vmmv^ = v^v\iJk){i^k\ = \tpk)mv^v = o 

and thus V{V)p = 0. 

A simpler, more physical example is a three-level A sys- 
tem with decay of the excited state |2) given by the LME 
with H = diag(0, 1,0) and Vi = |1)(2|, V2 = |3)(2|. The 
system has a DFS spanned by the stable ground states 
"Hdfs = span{|l), |3)} as we clearly have Vi\l) = Vi\3) = 




FIG. 5: Two atoms in separated cavities connected into a 
closed loop through optical fibers. The off-resonant driv- 
ing field A generates an effective Hamiltonian Heff — Z\Z2- 
Atom 1 is also driven by a resonant laser field generating a 
local Hamiltonian X\. In the time scale we are interested in, 
only atom 1 experiences spontaneous decay. 



and V2\\) = I^2|3) = and thus Vx\i}) = T/slV-) = for 
aU i\} = a\\)^ /3|3) and thus X>[Vi]/5 = V^2\p for any 

p = W;i|V'l)(V'l|+W2|V2)(V'2|, |V^fc>eHDFS, (22) 

for fc — 1,2, and "Hdfs is invariant under the Hamiltonian 
Fl. In this case it is easy to check that the corresponding 
invariant set €inv is precisely the face F at the boundary 
corresponding to density operators of the form (22). In 
fact, as the Hamiltonian is trivial on HdfSj al 



of the 

states with support on Hofs are actually steady states, 
i.e., €inv = Sss- This would no longer be the case if 
we changed the Hamiltonian to Fl' = |1)(3| -I- |3)(1|, for 
instance, but €inv would still be an invariant set. The re- 
quirement that Hdfs be invariant under the Hamiltonian 
dynamics is very important. If we change the Hamilto- 
nian above to Fl" — |1)(2| -I- 12)(1|, for example, then the 
system no longer has a DFS. In fact, it is easy to check 
that the invariant set collapses to a single point, here 
€inv = (£ss = {|3)(3|}. Other choices of the Hamiltonian 
will result in different steady states. As the states with 
support on a DFS must be contained in the invariant set 
€i,iv, only systems with non-trivial £inv admit DFS's. 
Another example are two spins subject to the LME 



P 



{ZxZi,p\ + 7il?[cri]p. 



where is the decay operator for spin fc and — 
<Jk<y\ — o'l.o'fc- Here we have an effective Ising interac- 
tion term and a decay term for the first spin. This 
model might describe an electron spin weakly coupled 
to stable a nuclear spin. The same model was derived 
for two atoms in separate cavities connected by optical 
fibers (Fig [5]) in the large-detuning regime [301 131] • In 
the latter case we could achieve 72 <C 71 by choosing 
different Q factors for the two cavities so that on cer- 
tain time scale that one atom experiences spontaneous 
decay while the other does not. For a system of this type 
the Hilbert space has a natural tensor product structure 
H = Hi ® ^2 and we immediately expect the invariant 
set to be {p = |0)i(0|i 18)^2} as subsystem 2 is clearly un- 
affected by dissipation, D[ai]{pi (g) P2) = {'D[ai]pi) ® p2. 
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It is easy to see that H is invariant on £inv, and the 
states |0) ® It/)) with \^) € '^2 also form a DFS. However, 
if atom 1 is driven by a resonant laser field O then the 
Lindblad dynamics becomes 

p = -ia[ZiZ2,p] ~ i^[Xi,p] + 7i2?[(Ti]p 

and the DFS disappears. The system still has a ID man- 
ifold of steady states but the Bloch superoperator A no 
longer has purely imaginary eigenvalues ±^7 with 7 > 0, 
i.e., the invariant set collapses to the ID manifold of 
steady states. 



VI. CONCLUSION 

We have theoretically investigated the convex set of the 
steady states and the invariant set of the Lindblad mas- 
ter equation, derived several sufficient conditions for the 
existence of a unique steady state, and applied these to 
different physical systems. One interesting result is that 
if one Lindblad term corresponds to an annihilation op- 
erator of the system then the stationary state is unique. 
Another useful result is that a composite system has a 
unique steady state if the Lindblad equation contains dis- 
sipation terms corresponding to annihilation operators 
for each subsystem. In both cases the result still holds 
if other dissipation terms are present, and regardless of 
the Hamiltonian. We also show that uniqueness implies 
asymptotic stability of the steady state and hence global 
attractivity. On the other hand, if there are at least two 
steady states, then there is a convex set of steady states, 
none of which are asymptotically stable. Furthermore, in 
this case even convergence to a steady state is not guar- 
anteed as there can be a larger invariant set surrounding 
the steady states, corresponding to the center manifold 
generated by the eigenspaces of the Bloch superoperator 
A with purely imaginary eigenvalues. The invariant set 
is closely related to decoherence-free subspaces; in par- 
ticular any state p with support on a DFS belongs to the 
invariant set. 

This characterization of the set of steady states and 
the invariant set, can be used to stabilize desired states 
using Hamiltonian and reservoir engineering, and we il- 
lustate how in principle any state, pure or mixed, can be 
stabilized this way. This can be extended to engineering 
decoherence-free subspaces. The latter are naturally at- 
tractive but attractivity of a subspace is a weak property 
in that almost all initial states will generally converge to 
mixed state trajectories with support on the subspace, 
not stationary pure states. One possibility of implement- 
ing such reservoir engineering is via direct feedback, e.g., 
by homodyne detection, which yields a feedback-modified 
master equation [TT] with Lindblad terms depending on 
the measurement and feedback Hamiltonians. This de- 
pendence shows that feedback can change the reservoir 
operators, and we have shown that in the absence of 
restrictions on the control, measurement, and feedback 



operators, any state can be rendered asympotically sta- 
ble by means of direct feedback. It will be interesting 
to consider what states can be stabilized, for example, 
given a restricted set of available measurement, control, 
and feedback Hamiltonians for specific physical models. 
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Appendix A: Existence of Steady States 

We can use Brouwer's fixed point theorem and Can- 
tor's intersection theorem to prove that any dynamical 
system whose flow is a continuous map 0( from a disk 
D" to itself, must have a fixed point, and the assump- 
tion that the domain is the disk Z?" can be relaxed to 
any simple-connected compact set. Specifically, we have: 

Theorem 3. Let x = f{x) be a dynamical system with a 
flow (j)t from a simply connected compact set D to itself. 
If 4>t is continuous, then there exists a fixed point. 

Proof. For any given T > 0, 4>t : D ^ D is a continuous 
map from D to itself. Applying Brouwer's fixed point 
theorem, there exists at least one fixed point. Denote 
the set of fixed points as St and observe that as a closed 
subset of a compact set 5'^ is compact. Similarly, we can 
find the set of fixed points St/2 for 4'T/2y which is also 
compact and satisfies S" * C St as a fixed point of (/jt /2 is 
also a fixed point of (/jt- By iterating this procedure we 
can construct a sequence of nonempty compact netting 
sets {St/2''} : • • • C St/2I' C St/2''-^ C • • • St c St- By 
Cantor intersection theorem, the intersection of {St/2''} 
is nonempty. Let xq be one of the points in the intersec- 
tion. Then for any T' = we have 4)t'{xq) = xq. 
Since such T' is dense for [0, +00) and (j)t a continuous 
flow, we know that for any time t, (f>t{xo) = xq, i.e. xq is 
a fixed of the dynamical system. □ 

Since the set of physical states is a compact simply con- 
nected set and the master equation clearly continuous, we 
can conclude that any system governed by a Lindblad 
master equation has a physical stationary state. 

Appendix B: Extremal points of Convex Set of 
Steady States 

Lemma 1. // p^ = spo -f (1 — s)pi is a convex combi- 
nation of the positive operators po, pi with < s < 1 
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then rank pg is constant and the support of pQ and pi is 
contained in the support of ps . 

Proof. If rank(/9s) = k then there exists a basis such that 
Ps = diag(ri, . . . , rfe, 0, . . .) with > and '^k = 1, 

i.e., the last N — k rows and columns of ps are 0. Since po 
and pi are positive operators and s > 0, this is possible 
only if the last N — k rows and columns of po and pi are 
zero, and thus the support of po and pi is contained in 
the support of ps- Furthermore, the rank of all ps on the 
open line segment < s < 1 must be the same. If there 
were two intermediate points with rank(ps) < Tank{pt) 
and < s < i < 1 then the support of po and pt would 
have to be contained in the support of Ps by the previous 
argument, which is impossible as rank(/3s) < rank(/3f). 
Similarly, forO<t<s<l. □ 

Theorem 4. Let T-Lg he the smallest suhspace of % that 
contains the support of all steady states. There exist a 
finite number of extremal steady states pk such that 
is the convex hull of {pk} and Hg = ®/jSupp(pk)- 

Proof. We know that a convex set is the convex hull of 
its extremal points but there may be many extremal 
points with nonorthogonal supports. Thus, what we 
need to show is that we can always choose a subset 
of the extremal points with mutually orthogonal sup- 
ports that generates the entire convex set of steady 
states. Given two extremal steady states pi, p2, ei- 
ther supp(/cii) _L supp(p2), or we can find another steady 
state p3 with supp(p2) C supp(pi) -I- supp(/92) such that 
supp(pi) _L supp(/53). Assuming we have already con- 
structed T-Lq = ®^~"'^supp(/9f ) with supp(pf) mutually or- 
thogonal, let Pk be another extremal point with supp(pk) 
not included in Hq and define T-Li = T-Lq -\- supp(pk)- By 
connecting pk and a fixed point with full rank in "Ho, 
we can find another steady state with full rank in Hi. 
So 7^1 is an invariant subspace under the dynamics on 
T-L. Therefore, in the following, we will restrict the dy- 
namics H and Vk on the subspace "Hi. Define P to be 
the projection operator of "Ho and P-^ to be the orthog- 
onal projection operator of P with respect to "Hi. In the 
block-diagonal diagonal form with respect to P and P^ , 



Pk 



Pll Pl2 
P21 P22 



Hii Hi2 
H21 H22 



Vn V12 
V21 V22 



where without loss of generality we only consider one 
Lindblad term. Since is an invariant subspace under 
the dynamics, we have 

= T/21 (Bla) 

= -J^vAyi2+«ffi2 (Bib) 



For a steady state p^, we have = p = —i\H^pk\ + 
'D[V]p. Since pk is an extremal point, P22 has full rank. 



Moreover, as pk is stationary in Hi, it is also stationary 
restricted to a subspace P-^Hi, which means 

= -i[H22, P22] + 2?[V22]P22- 



Substituting this as well as (Bl) into P22 = 0, we find 



P22Vi^2^12 + T^i^2^12P22 = 

which means V12 — since P22 has full rank. Together 
with (|bi| we have [H,P] = [V,P] 0. Hence P-^Hi 



is also an invariant space under the dynamics restricted 
on Hi. Combining the condition that Hi is an invari- 
ant subspace under the dynamics on we conclude 
that P-^Hi is also an invariant subspace under the dy- 
namics on H. There must exist an extremal fixed point 
Pk in P^Hi with support orthogonal to Hq. We have 
Hi = Hq © supp(pk). Continuing this process until all 
fixed points are included in ®fcSupp(pk), we finally obtain 
Hs = ®fesupp(pk). This construction can be completed 
in a finite number of steps as the dimension of Hs is 
finite. □ 



Appendix C: Proof of "No Isolated Centers" 
Theorem 



Suppose A has a pair of purely imaginary eigenvalues 
±ia. Let e be an eigenvector of A corresponding to the 
eigenvalue +ia with a > 0, i.e., Ctoti^) = Ae = iae. 
In the Schrodinger picture, we have e^^e = e*"*e. Let 
E be the operator, corresponding to e, in the adjoint 
operator space, with C\g^{E) — iaE. In the Heisen- 
berg picture, the adjoint dynamics gives E{t) = e'"*£^, 
and E{t)^E{t) = E^E, with E^ E always positive. We 
can scale E such that ||i?^£^||oo = 1- Thus, E^ E is 
a positive matrix with maximum eigenvalue Amax = 1 
and |0o) as the associated eigenvector. Hence, we have 
E^E\(j,a) = |0o) and Tr{E^EpQ) = Tr(A„,axPo) = 1, 
where po = \4>q){4>q\. Let us consider in the Schrodinger 
picture, the evolution of p{t) with initial state p(0) = po. 
We define the average state 



P{T) 



T 



p{t) dt. 



(CI) 



Setting D = E^E, switching between the Schrodinger 
and Heisenberg picture, and using the Kadison inequality 
D{t) > E{tyE{t) we obtain 

i-T 



MpD)^^J^ TT[pit)D]dt 



Ti[pD{t)] dt 



> 



^£TT[poE{t)^E{t)]dt 



Tr[po£;^£;] dt 



Ti{poE^E) = \\E^E\\oo = 1. 
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On the other hand, we have Ti{pE^E) < 1, and thus 
TripE^E) = 1. 

If the unique steady state Pss is in the interior of the 
convex set of physical states, i.e., pss has fuU rank, then 
p must have fuU rank for sufficiently large T as well, and 
this is possible only if E^E — I, i.e., E is unitary. Next 
we calculate the term E''^ Cl^f{E). From the evolution: 

lUe) = [iH, E]+J2 {vJeV, - liEVjV, + VjV.E)) , 



we have 

E^cUe) ^E^[zH,E] 

+ E (e^vJev, - \v]v, - Uwjv.E 



Therefore, we must have a = 0, which contradicts the 
initial assumption that a > 0. 



When the unique steady state is a mixed state at the 
boundary with 1 < rank(pss) < N, then we can partition 
the Hilbert space H = Hi ® H2 such that pss vanishes 
on 7^2. It has been shown that in this case all solutions 
are attracted to states with support on Hi. Thus, we 
can restrict the dynamics to Hi, i.e., the support of pss, 
and the same arguments as above imply that E^ E must 
equal the identity on the Hi subspace, E^E\fi^ = 1-^^, 
which leads to a contradiction. 



Since E is unitary, we have E^Cl^JE) = EUaE — iai. 
Taking the trace at both sides in ( |C2| , 

J2t<E^vJeV,) [Tr(i?t^^ty^.) +Tr(i?tl^t^^.^)- 

j 3 

+ iaN 

On the other hand, by Cauchy Schwartz inequality, 
\Y,T^r{E^V]EV,)\ 



< 



J2\TT{{E^VjE)iV,))\ 



If the unique fixed point pss happens to be a pure state 
at the boundary, then it is easy to see that there cannot 
be any loop paths, because the state p averaged over 
one period would have to equal the stationary state pss, 
which is not possible because a rank 1 projector cannot 
be written as a linear combination of other states. 



< J2 ^TT{E^VjEE^V,E)^Tr{VjV,) 
j 

<J2l [ME^vJv.E) + TrivJV,) 



Moreover, if Sgg is a center that belongs to a face F in 
the boundary, then the entire center manifold it belongs 
to must be contained in F as otherwise there would be 
loop planes intersecting the boundary and physical states 
evolving into non-physical states, which is forbidden. 
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